2026-10-27 17:44:32,742 [ 227305 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/_temp/test/git-repo-copy (runner:42, check_args_and_update_paths) 2026-10-27 17:44:32,743 [ 227305 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/_temp/test/git-repo-copy/tests/integration (runner:90, check_args_and_update_paths) 2026-10-27 17:44:32,743 [ 227305 ] INFO : src dir is not set. Will use /home/ubuntu/_work/_temp/test/git-repo-copy/src (runner:97, check_args_and_update_paths) 2026-10-27 17:44:32,743 [ 227305 ] INFO : base_configs_dir: /home/ubuntu/_work/_temp/test/git-repo-copy/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/_temp/test/git-repo-copy/tests/integration (runner:99, check_args_and_update_paths) 2026-10-27 17:44:32,743 [ 227305 ] INFO : Unknown image altinityinfra/dotnet-client (runner:357, ) Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_264zz0 --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/src/Server/grpc_protos:/ClickHouse/src/Server/grpc_protos --volume=/run:/run/host:ro --mount type=bind,source=/home/ubuntu/_work/_temp/test/dockerd_volume_dir,target=/var/lib/docker -e DOCKER_HELPER_TAG=1864 -e DOCKER_BASE_TAG=1864 -e DOCKER_KERBERIZED_HADOOP_TAG=1864 -e DOCKER_KERBEROS_KDC_TAG=1864 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=1864 -e DOCKER_MYSQL_JAVA_CLIENT_TAG=1864 -e DOCKER_MYSQL_JS_CLIENT_TAG=1864 -e DOCKER_MYSQL_PHP_CLIENT_TAG=1864 -e DOCKER_NGINX_DAV_TAG=1864 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=1864 -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 5 -rfEps --run-id=1 --color=no --durations=0 test_reload_certificate/test.py::test_chain_reload -vvv" altinityinfra/integration-tests-runner:1864 '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.7.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: repeat-0.9.4, order-1.0.1, random-0.2, timeout-2.2.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False created: 5/5 workers 5 workers [1 item] scheduling tests via LoadFileScheduling test_reload_certificate/test.py::test_chain_reload [gw0] [100%] FAILED test_reload_certificate/test.py::test_chain_reload =================================== FAILURES =================================== ______________________________ test_chain_reload _______________________________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 def test_chain_reload(): """Check cert chain reload""" > check_certificate_switch("first", "WithChain") test_reload_certificate/test.py:167: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_reload_certificate/test.py:116: in check_certificate_switch assert ( helpers/cluster.py:3840: in exec_in_container return self.cluster.exec_in_container( helpers/cluster.py:2012: in exec_in_container result = subprocess_check_call( helpers/cluster.py:158: in subprocess_check_call return run_and_check(args, detach=detach, nothrow=nothrow) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker', 'exec', 'roottestreloadcertificate_node_1', 'curl', '--silent', '--cacert', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8") err = res.stderr.decode("utf-8") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker', 'exec', 'roottestreloadcertificate_node_1', 'curl', '--silent', '--cacert', '/etc/clickhouse-server/config.d/WithChain.crt', 'https://localhost:8443/'] return non-zero code 60: helpers/cluster.py:121: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- WARNING: API is accessible on http://0.0.0.0:2375 without encryption. Access to the remote API is equivalent to root access on the host. Refer to the 'Docker daemon attack surface' section in the documentation for more information: https://docs.docker.com/go/attack-surface/ WARNING: API is accessible on http://0.0.0.0:2375 without encryption. Access to the remote API is equivalent to root access on the host. Refer to the 'Docker daemon attack surface' section in the documentation for more information: https://docs.docker.com/go/attack-surface/ ------------------------------ Captured log setup ------------------------------ 2026-10-27 17:44:36 [ 357 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:105, run_and_check) 2026-10-27 17:44:36 [ 357 ] DEBUG : Stdout:1 (cluster.py:113, run_and_check) 2026-10-27 17:44:36 [ 357 ] DEBUG : No running containers (conftest.py:60, cleanup_environment) 2026-10-27 17:44:36 [ 357 ] DEBUG : Pruning Docker networks (conftest.py:62, cleanup_environment) 2026-10-27 17:44:36 [ 357 ] DEBUG : Command:['docker network prune --force'] (cluster.py:105, run_and_check) 2026-10-27 17:44:36 [ 357 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:105, run_and_check) 2026-10-27 17:44:36 [ 357 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:113, run_and_check) 2026-10-27 17:44:36 [ 357 ] INFO : Running tests in /ClickHouse/tests/integration/test_reload_certificate/test.py (cluster.py:2637, start) 2026-10-27 17:44:36 [ 357 ] DEBUG : Cluster start called. is_up=False (cluster.py:2644, start) 2026-10-27 17:44:36 [ 357 ] DEBUG : !!! Docker info: Client: Docker Engine - Community Version: 29.9.2 Context: default Debug Mode: false Plugins: buildx: Docker Buildx (Docker Inc.) Version: v0.38.1 Path: /usr/libexec/docker/cli-plugins/docker-buildx compose: Docker Compose (Docker Inc.) Version: v5.6.1 Path: /usr/libexec/docker/cli-plugins/docker-compose Server: Containers: 0 Running: 0 Paused: 0 Stopped: 0 Images: 39 Server Version: 23.0.6 Storage Driver: overlay2 Backing Filesystem: extfs Supports d_type: true Using metacopy: false Native Overlay Diff: true userxattr: false Logging Driver: json-file Cgroup Driver: cgroupfs Cgroup Version: 2 Plugins: Volume: local Network: bridge host ipvlan macvlan null overlay Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog Swarm: inactive Runtimes: runc io.containerd.runc.v2 Default Runtime: runc Init Binary: docker-init containerd version: b7a25261e029d68978bbf290df0a62fc819b3c51 runc version: v1.5.2-0-g29dd3dc2 init version: de40ad0 Security Options: seccomp Profile: builtin cgroupns Kernel Version: 5.15.0-130-generic Operating System: Ubuntu 22.04.5 LTS (containerized) OSType: linux Architecture: x86_64 CPUs: 16 Total Memory: 30.59GiB Name: 34dddf14ccdf ID: 6bb2ce69-00d5-42af-bd67-4e555b8b7b5d Docker Root Dir: /var/lib/docker Debug Mode: false Experimental: false Insecure Registries: 65.108.242.32:5000 127.0.0.0/8 Registry Mirrors: http://65.108.242.32:5000/ Live Restore Enabled: false Default Address Pools: Base: 172.17.0.0/12, Size: 24 (cluster.py:722, print_all_docker_pieces) 2026-10-27 17:44:36 [ 357 ] DEBUG : Docker networks for project roottestreloadcertificate are NETWORK ID NAME DRIVER SCOPE (cluster.py:733, print_all_docker_pieces) 2026-10-27 17:44:36 [ 357 ] DEBUG : Docker containers for project roottestreloadcertificate are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:741, print_all_docker_pieces) 2026-10-27 17:44:36 [ 357 ] DEBUG : Docker volumes for project roottestreloadcertificate are DRIVER VOLUME NAME (cluster.py:749, print_all_docker_pieces) 2026-10-27 17:44:36 [ 357 ] DEBUG : Cleanup called (cluster.py:754, cleanup) 2026-10-27 17:44:37 [ 357 ] DEBUG : !!! Docker info: Client: Docker Engine - Community Version: 29.9.2 Context: default Debug Mode: false Plugins: buildx: Docker Buildx (Docker Inc.) Version: v0.38.1 Path: /usr/libexec/docker/cli-plugins/docker-buildx compose: Docker Compose (Docker Inc.) Version: v5.6.1 Path: /usr/libexec/docker/cli-plugins/docker-compose Server: Containers: 0 Running: 0 Paused: 0 Stopped: 0 Images: 39 Server Version: 23.0.6 Storage Driver: overlay2 Backing Filesystem: extfs Supports d_type: true Using metacopy: false Native Overlay Diff: true userxattr: false Logging Driver: json-file Cgroup Driver: cgroupfs Cgroup Version: 2 Plugins: Volume: local Network: bridge host ipvlan macvlan null overlay Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog Swarm: inactive Runtimes: io.containerd.runc.v2 runc Default Runtime: runc Init Binary: docker-init containerd version: b7a25261e029d68978bbf290df0a62fc819b3c51 runc version: v1.5.2-0-g29dd3dc2 init version: de40ad0 Security Options: seccomp Profile: builtin cgroupns Kernel Version: 5.15.0-130-generic Operating System: Ubuntu 22.04.5 LTS (containerized) OSType: linux Architecture: x86_64 CPUs: 16 Total Memory: 30.59GiB Name: 34dddf14ccdf ID: 6bb2ce69-00d5-42af-bd67-4e555b8b7b5d Docker Root Dir: /var/lib/docker Debug Mode: false Experimental: false Insecure Registries: 65.108.242.32:5000 127.0.0.0/8 Registry Mirrors: http://65.108.242.32:5000/ Live Restore Enabled: false Default Address Pools: Base: 172.17.0.0/12, Size: 24 (cluster.py:722, print_all_docker_pieces) 2026-10-27 17:44:37 [ 357 ] DEBUG : Docker networks for project roottestreloadcertificate are NETWORK ID NAME DRIVER SCOPE (cluster.py:733, print_all_docker_pieces) 2026-10-27 17:44:37 [ 357 ] DEBUG : Docker containers for project roottestreloadcertificate are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:741, print_all_docker_pieces) 2026-10-27 17:44:37 [ 357 ] DEBUG : Docker volumes for project roottestreloadcertificate are DRIVER VOLUME NAME (cluster.py:749, print_all_docker_pieces) 2026-10-27 17:44:37 [ 357 ] DEBUG : Command:docker container list --all --filter name='^/roottestreloadcertificate_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:105, run_and_check) 2026-10-27 17:44:37 [ 357 ] DEBUG : Unstopped containers: {} (cluster.py:768, cleanup) 2026-10-27 17:44:37 [ 357 ] DEBUG : No running containers for project: roottestreloadcertificate (cluster.py:782, cleanup) 2026-10-27 17:44:37 [ 357 ] DEBUG : Trying to prune unused networks... (cluster.py:788, cleanup) 2026-10-27 17:44:37 [ 357 ] DEBUG : Trying to prune unused images... (cluster.py:804, cleanup) 2026-10-27 17:44:37 [ 357 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:105, run_and_check) 2026-10-27 17:44:37 [ 357 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:113, run_and_check) 2026-10-27 17:44:37 [ 357 ] DEBUG : Images pruned (cluster.py:807, cleanup) 2026-10-27 17:44:37 [ 357 ] DEBUG : Trying to prune unused volumes... (cluster.py:813, cleanup) 2026-10-27 17:44:37 [ 357 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:105, run_and_check) 2026-10-27 17:44:37 [ 357 ] DEBUG : Stdout:1 (cluster.py:113, run_and_check) 2026-10-27 17:44:37 [ 357 ] DEBUG : Setup directory for instance: node (cluster.py:2657, start) 2026-10-27 17:44:37 [ 357 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4309, create_dir) 2026-10-27 17:44:37 [ 357 ] DEBUG : Create directory for common tests configuration (cluster.py:4314, create_dir) 2026-10-27 17:44:37 [ 357 ] DEBUG : Copy common configuration from helpers (cluster.py:4334, create_dir) 2026-10-27 17:44:37 [ 357 ] DEBUG : Generate and write macros file (cluster.py:4353, create_dir) 2026-10-27 17:44:37 [ 357 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_reload_certificate/configs/first.crt', '/ClickHouse/tests/integration/test_reload_certificate/configs/first.key', '/ClickHouse/tests/integration/test_reload_certificate/configs/second.crt', '/ClickHouse/tests/integration/test_reload_certificate/configs/second.key', '/ClickHouse/tests/integration/test_reload_certificate/configs/ECcert.crt', '/ClickHouse/tests/integration/test_reload_certificate/configs/ECcert.key', '/ClickHouse/tests/integration/test_reload_certificate/configs/WithChain.crt', '/ClickHouse/tests/integration/test_reload_certificate/configs/WithChain.key', '/ClickHouse/tests/integration/test_reload_certificate/configs/WithPassPhrase.crt', '/ClickHouse/tests/integration/test_reload_certificate/configs/WithPassPhrase.key', '/ClickHouse/tests/integration/test_reload_certificate/configs/cert.xml'] to /ClickHouse/tests/integration/test_reload_certificate/_instances_1/node/configs/config.d (cluster.py:4383, create_dir) 2026-10-27 17:44:37 [ 357 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_reload_certificate/_instances_1/node/database (cluster.py:4400, create_dir) 2026-10-27 17:44:37 [ 357 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_reload_certificate/_instances_1/node/logs (cluster.py:4411, create_dir) 2026-10-27 17:44:37 [ 357 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4487, create_dir) 2026-10-27 17:44:37 [ 357 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_reload_certificate/_instances_1/.env (cluster.py:78, _create_env_file) 2026-10-27 17:44:37 [ 357 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-27 17:44:37 [ 357 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-27 17:44:37 [ 357 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-27 17:44:37 [ 357 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-27 17:44:37 [ 357 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:546, _make_request) 2026-10-27 17:44:37 [ 357 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_reload_certificate/_instances_1/.env', '--project-name', 'roottestreloadcertificate', '--file', '/ClickHouse/tests/integration/test_reload_certificate/_instances_1/node/docker-compose.yml', 'pull'] (cluster.py:105, run_and_check) 2026-10-27 17:44:48 [ 357 ] DEBUG : Stderr:Pulling node ... (cluster.py:115, run_and_check) 2026-10-27 17:44:48 [ 357 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:115, run_and_check) 2026-10-27 17:44:48 [ 357 ] DEBUG : Stderr:Pulling node ... digest: sha256:45997363e17ff1831d... (cluster.py:115, run_and_check) 2026-10-27 17:44:48 [ 357 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:115, run_and_check) 2026-10-27 17:44:48 [ 357 ] DEBUG : Stderr:Pulling node ... done (cluster.py:115, run_and_check) 2026-10-27 17:44:48 [ 357 ] DEBUG : ('Trying to create ClickHouse instance by command %s', 'docker-compose --env-file /ClickHouse/tests/integration/test_reload_certificate/_instances_1/.env --project-name roottestreloadcertificate --file /ClickHouse/tests/integration/test_reload_certificate/_instances_1/node/docker-compose.yml up -d --no-recreate') (cluster.py:2980, start) 2026-10-27 17:44:48 [ 357 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_reload_certificate/_instances_1/.env', '--project-name', 'roottestreloadcertificate', '--file', '/ClickHouse/tests/integration/test_reload_certificate/_instances_1/node/docker-compose.yml', 'up', '-d', '--no-recreate'] (cluster.py:105, run_and_check) 2026-10-27 17:44:49 [ 357 ] DEBUG : Stderr:Creating network "roottestreloadcertificate_default" with the default driver (cluster.py:115, run_and_check) 2026-10-27 17:44:49 [ 357 ] DEBUG : Stderr:Creating roottestreloadcertificate_node_1 ... (cluster.py:115, run_and_check) 2026-10-27 17:44:49 [ 357 ] DEBUG : Stderr:Creating roottestreloadcertificate_node_1 ... done (cluster.py:115, run_and_check) 2026-10-27 17:44:49 [ 357 ] DEBUG : ClickHouse instance created (cluster.py:2988, start) 2026-10-27 17:44:49 [ 357 ] DEBUG : get_instance_ip instance_name=node (cluster.py:1971, get_instance_ip) 2026-10-27 17:44:49 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestreloadcertificate_node_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:49 [ 357 ] DEBUG : Waiting for ClickHouse start in node, ip: 172.16.1.2... (cluster.py:2995, start) 2026-10-27 17:44:49 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestreloadcertificate_node_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:49 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/ab36f4c31c617db2a2eb12120be3dc3f3143d7494db7ea0c29bb2b2156c4f357/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:49 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/ab36f4c31c617db2a2eb12120be3dc3f3143d7494db7ea0c29bb2b2156c4f357/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:49 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/ab36f4c31c617db2a2eb12120be3dc3f3143d7494db7ea0c29bb2b2156c4f357/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:49 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/ab36f4c31c617db2a2eb12120be3dc3f3143d7494db7ea0c29bb2b2156c4f357/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:49 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/ab36f4c31c617db2a2eb12120be3dc3f3143d7494db7ea0c29bb2b2156c4f357/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:49 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/ab36f4c31c617db2a2eb12120be3dc3f3143d7494db7ea0c29bb2b2156c4f357/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:49 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/ab36f4c31c617db2a2eb12120be3dc3f3143d7494db7ea0c29bb2b2156c4f357/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:49 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/ab36f4c31c617db2a2eb12120be3dc3f3143d7494db7ea0c29bb2b2156c4f357/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:49 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/ab36f4c31c617db2a2eb12120be3dc3f3143d7494db7ea0c29bb2b2156c4f357/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:50 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/ab36f4c31c617db2a2eb12120be3dc3f3143d7494db7ea0c29bb2b2156c4f357/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:50 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/ab36f4c31c617db2a2eb12120be3dc3f3143d7494db7ea0c29bb2b2156c4f357/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:50 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/ab36f4c31c617db2a2eb12120be3dc3f3143d7494db7ea0c29bb2b2156c4f357/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:50 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/ab36f4c31c617db2a2eb12120be3dc3f3143d7494db7ea0c29bb2b2156c4f357/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:50 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/ab36f4c31c617db2a2eb12120be3dc3f3143d7494db7ea0c29bb2b2156c4f357/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:50 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/ab36f4c31c617db2a2eb12120be3dc3f3143d7494db7ea0c29bb2b2156c4f357/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:50 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/ab36f4c31c617db2a2eb12120be3dc3f3143d7494db7ea0c29bb2b2156c4f357/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:50 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/ab36f4c31c617db2a2eb12120be3dc3f3143d7494db7ea0c29bb2b2156c4f357/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:50 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/ab36f4c31c617db2a2eb12120be3dc3f3143d7494db7ea0c29bb2b2156c4f357/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:50 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/ab36f4c31c617db2a2eb12120be3dc3f3143d7494db7ea0c29bb2b2156c4f357/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-27 17:44:51 [ 357 ] DEBUG : ClickHouse node started (cluster.py:2999, start) ------------------------------ Captured log call ------------------------------- 2026-10-27 17:44:51 [ 357 ] DEBUG : run container_id:roottestreloadcertificate_node_1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/cert.xml << EOF\n\n 8443\n \n \n /etc/clickhouse-server/config.d/first.crt\n /etc/clickhouse-server/config.d/first.key\n true\n true\n sslv2,sslv3\n true\n \n \n \n\nEOF'] (cluster.py:2004, exec_in_container) 2026-10-27 17:44:51 [ 357 ] DEBUG : Command:['docker', 'exec', 'roottestreloadcertificate_node_1', 'bash', '-c', 'cat > /etc/clickhouse-server/config.d/cert.xml << EOF\n\n 8443\n \n \n /etc/clickhouse-server/config.d/first.crt\n /etc/clickhouse-server/config.d/first.key\n true\n true\n sslv2,sslv3\n true\n \n \n \n\nEOF'] (cluster.py:105, run_and_check) 2026-10-27 17:44:51 [ 357 ] DEBUG : Executing query SYSTEM RELOAD CONFIG on node (cluster.py:3423, query) 2026-10-27 17:44:51 [ 357 ] DEBUG : run container_id:roottestreloadcertificate_node_1 detach:False nothrow:False cmd: ['curl', '--silent', '--cacert', '/etc/clickhouse-server/config.d/first.crt', 'https://localhost:8443/'] (cluster.py:2004, exec_in_container) 2026-10-27 17:44:51 [ 357 ] DEBUG : Command:['docker', 'exec', 'roottestreloadcertificate_node_1', 'curl', '--silent', '--cacert', '/etc/clickhouse-server/config.d/first.crt', 'https://localhost:8443/'] (cluster.py:105, run_and_check) 2026-10-27 17:44:51 [ 357 ] DEBUG : Stdout:Ok. (cluster.py:113, run_and_check) 2026-10-27 17:44:51 [ 357 ] DEBUG : run container_id:roottestreloadcertificate_node_1 detach:False nothrow:False cmd: ['curl', '--silent', '--cacert', '/etc/clickhouse-server/config.d/WithChain.crt', 'https://localhost:8443/'] (cluster.py:2004, exec_in_container) 2026-10-27 17:44:51 [ 357 ] DEBUG : Command:['docker', 'exec', 'roottestreloadcertificate_node_1', 'curl', '--silent', '--cacert', '/etc/clickhouse-server/config.d/WithChain.crt', 'https://localhost:8443/'] (cluster.py:105, run_and_check) 2026-10-27 17:44:51 [ 357 ] DEBUG : Exitcode:60 (cluster.py:117, run_and_check) 2026-10-27 17:44:51 [ 357 ] DEBUG : run container_id:roottestreloadcertificate_node_1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/cert.xml << EOF\n\n 8443\n \n \n /etc/clickhouse-server/config.d/WithChain.crt\n /etc/clickhouse-server/config.d/WithChain.key\n true\n true\n sslv2,sslv3\n true\n \n \n \n\nEOF'] (cluster.py:2004, exec_in_container) 2026-10-27 17:44:51 [ 357 ] DEBUG : Command:['docker', 'exec', 'roottestreloadcertificate_node_1', 'bash', '-c', 'cat > /etc/clickhouse-server/config.d/cert.xml << EOF\n\n 8443\n \n \n /etc/clickhouse-server/config.d/WithChain.crt\n /etc/clickhouse-server/config.d/WithChain.key\n true\n true\n sslv2,sslv3\n true\n \n \n \n\nEOF'] (cluster.py:105, run_and_check) 2026-10-27 17:44:51 [ 357 ] DEBUG : Executing query SYSTEM RELOAD CONFIG on node (cluster.py:3423, query) 2026-10-27 17:44:52 [ 357 ] DEBUG : run container_id:roottestreloadcertificate_node_1 detach:False nothrow:False cmd: ['curl', '--silent', '--cacert', '/etc/clickhouse-server/config.d/WithChain.crt', 'https://localhost:8443/'] (cluster.py:2004, exec_in_container) 2026-10-27 17:44:52 [ 357 ] DEBUG : Command:['docker', 'exec', 'roottestreloadcertificate_node_1', 'curl', '--silent', '--cacert', '/etc/clickhouse-server/config.d/WithChain.crt', 'https://localhost:8443/'] (cluster.py:105, run_and_check) 2026-10-27 17:44:52 [ 357 ] DEBUG : Exitcode:60 (cluster.py:117, run_and_check) --------------------------- Captured stderr teardown --------------------------- WARNING: API is accessible on http://0.0.0.0:2375 without encryption. Access to the remote API is equivalent to root access on the host. Refer to the 'Docker daemon attack surface' section in the documentation for more information: https://docs.docker.com/go/attack-surface/ ---------------------------- Captured log teardown ----------------------------- 2026-10-27 17:44:52 [ 357 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_reload_certificate/_instances_1/.env', '--project-name', 'roottestreloadcertificate', '--file', '/ClickHouse/tests/integration/test_reload_certificate/_instances_1/node/docker-compose.yml', 'stop', '--timeout', '20'] (cluster.py:105, run_and_check) 2026-10-27 17:44:54 [ 357 ] DEBUG : Stderr:Stopping roottestreloadcertificate_node_1 ... (cluster.py:115, run_and_check) 2026-10-27 17:44:54 [ 357 ] DEBUG : Stderr:Stopping roottestreloadcertificate_node_1 ... done (cluster.py:115, run_and_check) 2026-10-27 17:44:54 [ 357 ] DEBUG : Command:['bash', '-c', '[ -f /ClickHouse/tests/integration/test_reload_certificate/_instances_1/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_certificate/_instances_1/node/logs/stderr.log* || true'] (cluster.py:105, run_and_check) 2026-10-27 17:44:54 [ 357 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_reload_certificate/_instances_1/.env', '--project-name', 'roottestreloadcertificate', '--file', '/ClickHouse/tests/integration/test_reload_certificate/_instances_1/node/docker-compose.yml', 'down', '--volumes'] (cluster.py:105, run_and_check) 2026-10-27 17:44:55 [ 357 ] DEBUG : Stderr:Removing roottestreloadcertificate_node_1 ... (cluster.py:115, run_and_check) 2026-10-27 17:44:55 [ 357 ] DEBUG : Stderr:Removing roottestreloadcertificate_node_1 ... done (cluster.py:115, run_and_check) 2026-10-27 17:44:55 [ 357 ] DEBUG : Stderr:Removing network roottestreloadcertificate_default (cluster.py:115, run_and_check) 2026-10-27 17:44:55 [ 357 ] DEBUG : Cleanup called (cluster.py:754, cleanup) 2026-10-27 17:44:55 [ 357 ] DEBUG : !!! Docker info: Client: Docker Engine - Community Version: 29.9.2 Context: default Debug Mode: false Plugins: buildx: Docker Buildx (Docker Inc.) Version: v0.38.1 Path: /usr/libexec/docker/cli-plugins/docker-buildx compose: Docker Compose (Docker Inc.) Version: v5.6.1 Path: /usr/libexec/docker/cli-plugins/docker-compose Server: Containers: 0 Running: 0 Paused: 0 Stopped: 0 Images: 39 Server Version: 23.0.6 Storage Driver: overlay2 Backing Filesystem: extfs Supports d_type: true Using metacopy: false Native Overlay Diff: true userxattr: false Logging Driver: json-file Cgroup Driver: cgroupfs Cgroup Version: 2 Plugins: Volume: local Network: bridge host ipvlan macvlan null overlay Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog Swarm: inactive Runtimes: runc io.containerd.runc.v2 Default Runtime: runc Init Binary: docker-init containerd version: b7a25261e029d68978bbf290df0a62fc819b3c51 runc version: v1.5.2-0-g29dd3dc2 init version: de40ad0 Security Options: seccomp Profile: builtin cgroupns Kernel Version: 5.15.0-130-generic Operating System: Ubuntu 22.04.5 LTS (containerized) OSType: linux Architecture: x86_64 CPUs: 16 Total Memory: 30.59GiB Name: 34dddf14ccdf ID: 6bb2ce69-00d5-42af-bd67-4e555b8b7b5d Docker Root Dir: /var/lib/docker Debug Mode: false Experimental: false Insecure Registries: 65.108.242.32:5000 127.0.0.0/8 Registry Mirrors: http://65.108.242.32:5000/ Live Restore Enabled: false Default Address Pools: Base: 172.17.0.0/12, Size: 24 (cluster.py:722, print_all_docker_pieces) 2026-10-27 17:44:55 [ 357 ] DEBUG : Docker networks for project roottestreloadcertificate are NETWORK ID NAME DRIVER SCOPE (cluster.py:733, print_all_docker_pieces) 2026-10-27 17:44:55 [ 357 ] DEBUG : Docker containers for project roottestreloadcertificate are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:741, print_all_docker_pieces) 2026-10-27 17:44:55 [ 357 ] DEBUG : Docker volumes for project roottestreloadcertificate are DRIVER VOLUME NAME (cluster.py:749, print_all_docker_pieces) 2026-10-27 17:44:55 [ 357 ] DEBUG : Command:docker container list --all --filter name='^/roottestreloadcertificate_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:105, run_and_check) 2026-10-27 17:44:55 [ 357 ] DEBUG : Unstopped containers: {} (cluster.py:768, cleanup) 2026-10-27 17:44:55 [ 357 ] DEBUG : No running containers for project: roottestreloadcertificate (cluster.py:782, cleanup) 2026-10-27 17:44:55 [ 357 ] DEBUG : Trying to prune unused networks... (cluster.py:788, cleanup) 2026-10-27 17:44:55 [ 357 ] DEBUG : Trying to prune unused images... (cluster.py:804, cleanup) 2026-10-27 17:44:55 [ 357 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:105, run_and_check) 2026-10-27 17:44:55 [ 357 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:113, run_and_check) 2026-10-27 17:44:55 [ 357 ] DEBUG : Images pruned (cluster.py:807, cleanup) 2026-10-27 17:44:55 [ 357 ] DEBUG : Trying to prune unused volumes... (cluster.py:813, cleanup) 2026-10-27 17:44:55 [ 357 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:105, run_and_check) 2026-10-27 17:44:55 [ 357 ] DEBUG : Stdout:1 (cluster.py:113, run_and_check) ============================== slowest durations =============================== 14.38s setup test_reload_certificate/test.py::test_chain_reload 3.60s teardown test_reload_certificate/test.py::test_chain_reload 1.20s call test_reload_certificate/test.py::test_chain_reload =========================== short test summary info ============================ FAILED test_reload_certificate/test.py::test_chain_reload - Exception: Comman... ============================== 1 failed in 20.28s ============================== Traceback (most recent call last): File "/home/ubuntu/_work/_temp/test/git-repo-copy/tests/integration/./runner", line 455, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_264zz0 --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/src/Server/grpc_protos:/ClickHouse/src/Server/grpc_protos --volume=/run:/run/host:ro --mount type=bind,source=/home/ubuntu/_work/_temp/test/dockerd_volume_dir,target=/var/lib/docker -e DOCKER_HELPER_TAG=1864 -e DOCKER_BASE_TAG=1864 -e DOCKER_KERBERIZED_HADOOP_TAG=1864 -e DOCKER_KERBEROS_KDC_TAG=1864 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=1864 -e DOCKER_MYSQL_JAVA_CLIENT_TAG=1864 -e DOCKER_MYSQL_JS_CLIENT_TAG=1864 -e DOCKER_MYSQL_PHP_CLIENT_TAG=1864 -e DOCKER_NGINX_DAV_TAG=1864 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=1864 -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 5 -rfEps --run-id=1 --color=no --durations=0 test_reload_certificate/test.py::test_chain_reload -vvv" altinityinfra/integration-tests-runner:1864 ' returned non-zero exit status 1.